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Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1)E3 Responsive to communication(s) filed on 31 March 2005 . 
2a)g] This action is FINAL. 2b)D This action is non-final. 

3) Q Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1 935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 1-18 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) [X] Claim(s) 1-18 is/are rejected. 

7) Q Claim(s) is/are objected to. 

8) Q Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

1 1) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-1 52. 

Priority under 35 U.S.C. § 119 

1 2) Q Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 1 9(a)-(d) or (f). 
a)D All b)D Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. Q Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attachment (s) 

1 ) S Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-41 3) 

2) □ Notice of Drafts person's Patent Drawing Review (PTO-948) Paper No(s)/Mail Date. . 

3) O Information Disclosure Statement(s) (PTO-1 449 or PTO/SB/08) 5 ) D Notice of Informal Patent Application (PTO-1 52) 

Paper No(s)/Mail Date . 6) O Other: . 



U.S. Patent and Trademark Office 

PTOL-326 (Rev. 1-04) 



Office Action Summary 



Part of Paper NoVMail Date 20050623 



t 



Application/Control Number: 09/931 ,21 1 Page 2 

Art Unit: 2152 

DETAILED ACTION 

This action is in response to Applicant's amendment filed on 3/31/05. Claims 1- 
18 are being examined. 



Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 1-18 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Shaffer et al, 6,775,247 (Shaffer hereafter) in view of Sandvoss et al, 5,745,380 
(Sandvoss hereafter). 

As per claim 1, Shaffer discloses a computer-readable medium having computer- 
executable instructions for a bridge server (102, fig. 2; refers to as multimedia 
conference unit or 'MCU'; MCU is functionally equivalent to bridge server) in a 
multimedia conference to select one video stream (from dominant communication unit 
or client) from video streams of multiple participants of the multimedia conference for 
forwarding to a client (abstract), the steps comprising: receiving simultaneously 
multimedia conferencing data from the multiple participants, the multimedia conference 
data including a video stream from each of the participants (col. 5, line 62 - col. 6, line 
6; col. 2, lines 36-46; MCU simultaneously receives and transmits multimedia data 
packets between plurality of clients {refers to as personal conferencing systems or 
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PCS'}); monitoring participant events of the multimedia conference; updating 
conferencing activity states for each of the participants according to the participant 
events (col. 7, lines 27-31; MCU continuously monitors activity states of each participant 
to determine which user is dominant user); identifying a dominant participant (highest 
weight) among the participants and selecting from the video streams in the multimedia 
conferencing data received from the participants one video stream corresponding to the 
identified participant having the dominant status (highest weight) for viewing by the 
client (col. 2, lines 36-36; col. 4, lines 39-45; col. 7, lines 34-39; the MCU, via its selector 
unit 'SU' (103, fig. 2), selects a dominant stream (sent by a dominant participant) from 
plurality of streams and relay the stream to other participants in the conference 
session). Shaffer does not explicitly disclose periodically computing a weight for each 
of the participants based on the conferencing activity states of said each participant. 
However, in related art, Sandvoss discloses periodically computing a weight for each of 
the participants based on the conferencing activity states of said each participant (col. 3, 
lines 53-57; col. 5, lines 35-45; stream weights are computed for each participant based 
on their activity states, i.e., active streams have higher weights than passive streams 
[col. 5, lines 47-50]). Hence, it would have been obvious to one of ordinary skill in the 
art to be motivated to modify and combine the teachings of Shaffer and Sandvoss in 
assigning weight values to activities in order to determine which participant is the most 
active in the multimedia conferencing system. 

Claim 10 recites similar limitations to claim 1; therefore, it is rejected by similar 
rationale as claim 1 addressed above. Shaffer further discloses a plurality of 
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participants each providing multimedia conferencing data including video signals and 
audio signals (col. 1, lines 34-36); a client in conference with the participants, the client 
capable of receiving a video stream corresponding to one of the participants at a time 
(col. 5, lines 33-39; a client receives a multimedia stream from only one (dominant) 
client at a time). 

As per claims 2-3, Shaffer discloses multiple participants are connected to the 
bridge server through a multicast network (col. 3, lines 48-50); transmitting to the client 
an audio stream containing a mixture of audio signals from the multiple participants of 
the network conference (col. 5, lines 50-56; a client can select to receive multimedia 
signals from multiple participants to view). 

As per claims 4-7, Shaffer does not explicitly disclose computing the weight 
includes determining whether said each participant is currently being shown to the 
client; length of time for which said each participant has been shown to the client if said 
each participant is currently being shown; computing the weight includes determining 
whether said each participant is talking. However, as previously stated in claim 1 
above, Sandvoss discloses computing weights based on activities of the participants. 
Sandvoss further discloses computing weights include when the participant is talking 
and the length of time they are talking (or showing via multimedia conference) (col. 6, 
lines 1-5 & 10-13). Hence, it would have been obvious to one of ordinary in the art to be 
motivated to compute the weights using any criteria to determine the most dominant 
and active participant as disclosed by Sandvoss in [col. 6, lines 5-10]. 
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As per claims 8 and 17, Shaffer discloses monitoring and updating the activity 
states of the participants (col. 7, lines 29-31 ). It is inherent that the activity values are 
stored and updated in a table to be accessed and used by the system to determine the 
dominant participant. 

As per claims 9 and 18, Shaffer does not explicitly teach the multimedia 
conference streams include a combined video stream containing multiple substreams 
each corresponding to one of the multiple participants, and wherein the step of receiving 
includes demultiplexing the combined video stream into a plurality of individual video 
streams each including one of the substreams in the combined video stream. However, 
it is well known to one of ordinary skill in the art for a sender to use a multiplexer to 
combine and compress multiple substreams into one stream and a receiver to use a 
demultiplexer to decompress the stream into multiple substreams to save bandwidth 
and costs when sending the stream over the network. 

Claims 11-12 are rejected for similar reasons as claims 2-3 addressed above. 

Claims 13-16 are rejected for similar reasons as claims 4-7 addressed above. 

Response to Arguments 

Applicant's arguments filed 3/31/05 have been fully considered but they are not 
persuasive. 

As to point 1 : In the remarks, Applicant argues Shaffer does not disclose or 
suggest, "...the selection of a video stream from received multimedia conferencing 
data." 
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Examiner respectfully traverses the remark. The concept of plurality of clients 
connecting and sending data simultaneously to each other in a multi-media 
conferencing session is not new or novel as recited in the amended claims. Prior art 
teachings from Shaffer also discloses concept. Additional teachings from Shaffer that 
the applicant refers to as 'teaching away' from the amended claims provide additional 
ways or methodologies of using multi-media conferencing that is beyond the scope of 
the claim limitations. Examiner interprets the claims as broadly as allowable. 
Therefore, at minimum, Shaffer does teach the claim limitations. Furthermore, since 
this is a USC 103 rejection, it would have been obvious to one of ordinary skill in the art 
to use or modify the teachings of Shaffer to arrive at the claim limitations - by allowing 
the conference system to receive plurality of streams from plurality of users 
simultaneously. The motivation to do this is to ensure the clients can communicate with 
the conference system. Prior art is used to show that this concept is not new or novel 
as recited in the claim. 

Regarding the Shaffer teachings, Shaffer shows a plurality of participants or 
clients (108, 110, fig. 3b) connected to a multimedia conferencing unit or system 'MCU' 
(102, fig. 3b) to exchange multimedia conferencing data with each other and MCU is 
receiving plurality of streams (124, 126, fig. 3b; MCU receives video A and video B 
streams sent by participants A and B) from plurality of participants simultaneously in a 
multimedia conferencing session (col. 5, line 62 - col. 6, line 6). Shaffer further shows 
the conferencing system, via its selector unit ( SU' (103, fig. 2), selects a dominant 
stream (sent from a dominant participant) and relay the stream to other participants in 
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the conference session (col. 2, lines 36-46; col. 4, lines 39-45; col. 7, lines 33-39; upon 
receiving multiple streams from multiple clients, the conferencing system, via the 
selector unit, selects the dominant stream for transmission to other participants). 

The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure - US Pat 6,757,259; 6,353,848; 6,332,153; 5,916,302; 6,907,449; 
6,343,313; 6,237,040. 

Conclusion 

THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Jack P Nguyen whose telephone number is (571) 272- 
3945. The examiner can normally be reached on M-F 8:30-5:00 PM. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Glenn Burgess can be reached on (571) 272-3999. The fax phone number 
for the organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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